Image sensor compensation

ABSTRACT

Compensation is performed for an image capture device which includes an image sensor which has a tunable spectral response and which is tunable in accordance with a capture mask. The compensation is for spatial non-uniformity in color sensitivity of the image sensor. A default capture mask is applied to the image sensor, and a sample image is captured using the image sensor tuned by the default capture mask. Color of the sample image is analyzed to identify spatial non-uniformity in color sensitivity of the image sensor. A compensation capture mask is constructed. The compensation capture mask is constructed using calculations based on the identified spatial non-uniformity so as to compensate for spatial non-uniformity in color sensitivity of the image sensor. The compensation capture mask is stored in a memory of the image capture device for application of the compensation capture mask to the image sensor.

CROSS-REFERENCE TO RELATED APPLICATION

This application is a continuation-in-part of U.S. patent applicationSer. No. 13/029,076, filed Feb. 16, 2011, and claims the benefit of suchapplication, the contents of which are hereby incorporated by referenceas if fully stated herein.

FIELD

The present disclosure relates to compensation for non-uniformity in animage sensor.

BACKGROUND

In the field of image sensors, because of factors such as manufacturingtolerances, impurities and environmental conditions that might lead toirregularities in parts of the sensor, the image sensor might notproduce a uniform output signal, even when subjected to a uniformstimulus.

To compensate for non-uniformities, a manual calibration of the imagesensor is sometimes performed. In this calibration process, correctiveparameters such as bias and scale factor are derived. In use duringimage capture, the corrective parameters are applied to raw output fromthe image sensor, so as to obtain corrected output signals in whichnon-uniformities are reduced.

SUMMARY

One problem with the above method is that such manual calibration mustbe performed post-capture of the image data. Thus, the raw sensor outputis already incorrectly non-uniform, and contains defects and errors.Accordingly, any further adjustment of the image sensor and/orprocessing of the image itself must start from a raw image signal whichalready contains such defects and errors.

The disclosure herein addresses the foregoing and compensates forspatial non-uniformity in color sensitivity of an image sensor bygenerating a compensation capture mask for a tunable image sensor priorto image capture, and by applying the mask at the time of image capture.

Thus, in an example embodiment described herein, compensation isperformed for an image capture device which includes an image sensorwhich has a tunable spectral response and which is tunable in accordancewith a capture mask. The compensation is for spatial non-uniformity incolor sensitivity of the image sensor. A default capture mask is appliedto the image sensor, and a sample image is captured using the imagesensor tuned by the default capture mask. Color of the sample image isanalyzed to identify spatial non-uniformity in color sensitivity of theimage sensor. A compensation capture mask is constructed for applicationto the image sensor. The compensation capture mask is constructed usingcalculations based on the identified spatial non-uniformity so as tocompensate for spatial non-uniformity in color sensitivity of the imagesensor. The compensation capture mask is stored in a memory of the imagecapture device for application of the compensation capture mask to theimage sensor.

By generating a compensation capture mask for a tunable image sensorprior to image capture and applying the mask at the time of imagecapture to compensate for spatial non-uniformity in color sensitivity ofthe image sensor, it is ordinarily possible to provide improvedcompensation, because the mask addresses non-uniformities whilecapturing the raw image signal. Thus, any further adjustment of theimage sensor and/or processing of the image begins from a raw imagesignal with reduced defects and errors.

This brief summary has been provided so that the nature of thisdisclosure may be understood quickly. A more complete understanding canbe obtained by reference to the following detailed description and tothe attached drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIGS. 1A and 1B are views depicting an external appearance of an imagecapture device according to an example embodiment.

FIGS. 2A, 2B and 2C are detailed block diagrams for explaining theinternal architecture of the image capture device shown in FIG. 1according to example embodiments.

FIGS. 3A and 3B are views for explaining an image processing moduleaccording to example embodiments.

FIGS. 4A and 4B are flow diagrams for explaining processing in the imagecapture device shown in FIG. 1 according to example embodiments.

FIG. 5 is a view for explaining compensation in a tunable sensoraccording to an example embodiment.

FIG. 6 is a view for explaining RGB sensitivities according to anexample embodiment.

FIG. 7 is a view for explaining sensitivities of combined pixelsaccording to an example embodiment.

FIG. 8 is a view for explaining original and compensated spectralsensitivity curves according to an example embodiment.

DETAILED DESCRIPTION

In the following example embodiments, there is described a digitalcamera which may be a digital still camera or a digital video camera. Itis understood, however, that the following description encompassesarbitrary arrangements which can incorporate or utilize imagingassemblies having a spectral response which is tunable in accordancewith a capture parameter, for instance, a data processing apparatushaving an image sensing function (e.g., a personal computer) or aportable terminal having an image sensing function (e.g., a mobiletelephone).

FIGS. 1A and 1B are views showing an example of an external appearanceof an image capture device 100 according to an example embodiment. Notein these figures, some components are omitted for conciseness. A useroperates buttons and switches 301 to 311 for turning ON/OFF the power ofthe digital camera 100, for setting, changing or confirming the shootingparameters, for confirming the status of the camera, and for confirmingshot images.

Optical finder 104 is a viewfinder, through which a user can view ascene to be captured. In this embodiment optical finder 104 is separatefrom image display unit 28, but in some embodiments image display unit28 may also function as a viewfinder.

Flash (flash emission device) 48 is for emitting auxiliary light toilluminate a scene to be captured, if necessary.

Image sensor 14, hidden inside the camera, is an image sensor whichconverts an optical image into an electrical signal. In this embodiment,image sensor 14 is a multi-spectral image sensor with a spectralresponse which is tunable in accordance with a capture parameter. Imagesensor 14 will be described more fully below with respect to FIG. 2A.

The power button 311 is provided to start or stop the digital camera100, or to turn ON/OFF the main power of the digital camera 100. Themenu button 302 is provided to display the setting menu such as shootingparameters and operation modes of the digital camera 100, and to displaythe status of the digital camera 100. The menu includes selectable itemsor items whose values are variable.

A delete button 301 is pressed for deleting an image displayed on aplayback mode or a shot-image confirmation screen. In the presentembodiment, the shot-image confirmation screen (a so-called quick reviewscreen) is provided to display a shot image on the image display unit 28immediately after shooting for confirming the shot result. Furthermore,the present embodiment is constructed in a way that the shot-imageconfirmation screen is displayed as long as a user keeps pressing theshutter button 310 after the user instructs shooting by shutter buttondepression.

An enter button 303 is pressed for selecting a mode or an item. When theenter button 303 is pressed, a system controller 50 (shown in FIG. 2A)sets the mode or item selected at this time. The display ON/OFF button66 is used for selecting displaying or non-displaying of photographinformation regarding the shot image, and for switching the imagedisplay unit 28 to be functioned as an electronic view finder.

A left button 355, a right button 356, an up button 357, and a downbutton 358 may be used for the following purposes, for instance,changing an option (e.g., items, images) selected from plural options,changing an index position that specifies a selected option, andincreasing or decreasing numeric values (e.g., correction value, dateand time).

Half-stroke of the shutter button 310 instructs the system controller 50to start, for instance, AF processing, AE processing, AWB processing, EFprocessing or the like. Full-stroke of the shutter button 310 instructsthe system controller 50 to perform shooting.

The zoom operation unit 65 is operated by a user for changing the angleof view (zooming magnification or shooting magnification).

A recording/playback selection switch 312 is used for switching arecording mode to a playback mode, or switching a playback mode to arecording mode. Note, in place of the above-described operation system,a dial switch may be adopted or other operation systems may be adopted.

FIG. 2A is a block diagram showing an example of the arrangement of thedigital camera 100 as an image capturing device according to thisembodiment. Referring to FIG. 2A, reference numeral 10 denotes animaging lens; 12, a shutter having an aperture function; and 14, animage sensor which has a spectral response which is tunable inaccordance with a capture parameter, and which converts an optical imageinto an electrical signal. Reference numeral 16 denotes an A/D converterwhich converts an analog signal into a digital signal. The A/D converter16 is used when an analog signal output from the image sensor 14 isconverted into a digital signal and when an analog signal output from anaudio controller 11 is converted into a digital signal. Referencenumeral 102 denotes a shield, or barrier, which covers the image sensorincluding the lens 10 of the digital camera 100 to prevent an imagecapturing system including the lens 10, shutter 12, and image sensor 14from being contaminated or damaged.

In FIG. 2A, an imaging assembly is comprised of image sensor 14 andassociated optics, such that in some embodiments the imaging assembly iscomprised of image sensor 14 and lens 10.

The optical system 10 may be of a zoom lens, thereby providing anoptical zoom function. The optical zoom function is realized by drivinga magnification-variable lens of the optical system 10 using a drivingmechanism of the optical system 10 or a driving mechanism provided onthe main unit of the digital camera 100.

A light beam (light beam incident upon the angle of view of the lens)from an object in a scene that goes through the optical system (imagesensing lens) 10 passes through an opening of a shutter 12 having adiaphragm function, and forms an optical image of the object on theimage sensing surface of the image sensor 14. The image sensor 14converts the optical image to analog image signals and outputs thesignals to an A/D converter 16. The A/D converter 16 converts the analogimage signals to digital image signals (image data). The image sensor 14and the A/D converter 16 are controlled by clock signals and controlsignals provided by a timing generator 18. The timing generator 18 iscontrolled by a memory controller 22 and the system controller 50.

Image sensor 14 is an image sensor which has a spectral response whichis tunable in accordance with a capture parameter 17. In one example,image sensor 14 outputs five or more channels of color information foreach pixel, including a red-like channel, a green-yellow-like channel, agreen-like channel, a blue-green-like channel, and a blue-like channel.The precise nature of the spectral responsivity of image sensor 14 iscontrolled via capture parameter 17. In this embodiment, captureparameter 17 may be comprised of multiple spatial masks, with one maskeach for each channel of information output by image sensor 14. Thus, inthis example, where image sensor 14 outputs five or more channels,capture parameter 17 includes a spatial mask DR for the red-like channelof information, a spatial mask DGY for the green-yellow-like channel ofinformation, a spatial mask DG for the green-like channel ofinformation, a spatial mask DBG for the blue-greem-like channel ofinformation and a spatial mask DB for the blue-like channel ofinformation. Each spatial mask comprises an array of control parameterscorresponding to pixels or regions of pixels in image sensor 14. Thespectral responsivity of each pixel, or each region of plural pixels, isthus tunable individually and independently of other pixels or regionsof pixels. In that regard, Image sensor 14 may be comprised of atransverse field detector (TFD) sensor, and spatial masks DR, DGY, DG,DBG and DB may correspond to voltage biases applied to controlelectrodes of the TFD sensor.

In the embodiment herein, the image sensor 14 is not preceded by a colorfilter array (CFA). A color filter array is one method to addressspatial non-uniformities. An example of such a CFA is described in U.S.Pat. No. 6,226,034 (Katayama), the contents of which are incorporated byreference herein. However, the use of a CFA leads to a number ofdisadvantages. For example, CFAs often have low sensitivity, so asignificant amount of signals (data) can be lost. In that regard, theinclusion of any filter necessarily decreases the signal-to-noise ratioby filtering the amount of light incident on the image sensor. Moreover,implementing a CFA for each pixel can be prohibitively expensive and maynot be physically possible, particularly in smaller cameras. Thus,according to the present embodiment, the image sensor 14 is not precededby a CFA.

Reference numeral 18 denotes a timing generator, which supplies clocksignals and control signals to the image sensor 14, the audio controller11, the A/D converter 16, and a D/A converter 26. The timing generator18 is controlled by a memory controller 22 and system controller 50.Reference numeral 20 denotes an image processor, which applies resizeprocessing such as predetermined interpolation and reduction, and colorconversion processing to data from the A/D converter 16 or that from thememory controller 22. The image processor 20 executes predeterminedarithmetic processing using the captured image data, and the systemcontroller 50 executes exposure control and ranging control based on theobtained arithmetic result.

As a result, TTL (through-the-lens) AF (auto focus) processing, AE (autoexposure) processing, and EF (flash pre-emission) processing areexecuted. The image processor 20 further executes predeterminedarithmetic processing using the captured image data, and also executesTTL AWB (auto white balance) processing based on the obtained arithmeticresult. It is understood that in other embodiments, optical finder 104may be used in combination with the TTL arrangement, or in substitutiontherefor.

Output data from the A/D converter 16 is written in a memory 30 via theimage processor 20 and memory controller 22 or directly via the memorycontroller 22. The memory 30 stores image data which is captured by theimage sensor 14 and is converted into digital data by the A/D converter16, and image data to be displayed on an image display unit 28. Theimage display unit 28 may be a liquid crystal screen. Note that thememory 30 is also used to store audio data recorded via a microphone 13,still images, movies, and file headers upon forming image files.Therefore, the memory 30 has a storage capacity large enough to store apredetermined number of still image data, and movie data and audio datafor a predetermined period of time.

A compression/decompression unit 32 compresses or decompresses imagedata by adaptive discrete cosine transform (ADCT) or the like. Thecompression/decompression unit 32 loads captured image data stored inthe memory 30 in response to pressing of the shutter 310 as a trigger,executes the compression processing, and writes the processed data inthe memory 30. Also, the compression/decompression unit 32 appliesdecompression processing to compressed image data loaded from adetachable recording unit 202 or 212, as described below, and writes theprocessed data in the memory 30. Likewise, image data written in thememory 30 by the compression/decompression unit 32 is converted into afile by the system controller 50, and that file is recorded in therecording unit 202 or 212, as also described below.

The memory 30 also serves as an image display memory (video memory).Reference numeral 26 denotes a D/A converter, which converts imagedisplay data stored in the memory 30 into an analog signal, and suppliesthat analog signal to the image display unit 28. Reference numeral 28denotes an image display unit, which makes display according to theanalog signal from the D/A converter 26 on the liquid crystal screen 28of an LCD display. In this manner, image data to be displayed written inthe memory 30 is displayed by the image display unit 28 via the D/Aconverter 26.

The exposure controller 40 controls the shutter 12 having a diaphragmfunction based on the data supplied from the system controller 50. Theexposure controller 40 may also have a flash exposure compensationfunction by linking up with a flash (flash emission device) 48. Theflash 48 has an AF auxiliary light projection function and a flashexposure compensation function.

The distance measurement controller 42 controls a focusing lens of theoptical system 10 based on the data supplied from the system controller50. A zoom controller 44 controls zooming of the optical system 10. Ashield controller 46 controls the operation of a shield (barrier) 102 toprotect the optical system 10.

Reference numeral 13 denotes a microphone. An audio signal output fromthe microphone 13 is supplied to the A/D converter 16 via the audiocontroller 11 which includes an amplifier and the like, is convertedinto a digital signal by the A/D converter 16, and is then stored in thememory 30 by the memory controller 22. On the other hand, audio data isloaded from the memory 30, and is converted into an analog signal by theD/A converter 26. The audio controller 11 drives a speaker 15 accordingto this analog signal, thus outputting a sound.

A nonvolatile memory 56 is an electrically erasable and recordablememory, and uses, for example, an EEPROM. The nonvolatile memory 56stores constants, computer-executable programs, and the like foroperation of system controller 50. Note that the programs include thosefor execution of various flowcharts.

In particular, as shown in FIG. 2B, non-volatile memory 56 is an exampleof a non-transitory computer-readable memory medium, having retrievablystored thereon image capture module 300 as described herein. Accordingto this example embodiment, the image capture module 300 includes atleast a default mask module 301 for applying a default capture mask tothe image sensor, a sample module 302 capturing a sample image using theimage sensor tuned by the default capture mask, and an analysis module303 for analyzing color of the sample image to identify spatialnon-uniformity in color sensitivity of the image sensor. Image capturemodule 300 further includes a compensation mask module 304 forconstructing a compensation capture mask for application to the imagesensor. The compensation capture mask is constructed using calculationsbased on the identified spatial non-uniformity so as to compensate forspatial non-uniformity in color sensitivity of the image sensor. Storagemodule 305 stores the compensation capture mask in a memory of the imagecapture device for application of the compensation capture mask to theimage sensor. In some embodiments, such as that shown in FIG. 2B, imagecapture module 300 may also include application module 306 for applyingthe compensation capture mask to the image sensor, and a capture module307 for capturing and storing an image of a scene using the image sensortuned by the compensation capture mask. These modules will be discussedin more detail below with respect to FIG. 3A.

In another example embodiment shown in FIG. 2C, non-volatile memory 56is an example of a non-transitory computer-readable memory medium,having retrievably stored thereon image capture module 370 as describedherein. According to this example embodiment, the image capture module370 includes at least a default mask module 371 for applying a defaultcapture mask to the image sensor, a sample module 372 for capturing asample image using the image sensor tuned by the default capture mask,and a uniform color module 373 for obtaining a uniform color imagecomprising a spatial array in which color values for each channel areuniform throughout the whole array. Image capture module 370 furtherincludes a compensation mask module 374 for constructing a compensationcapture mask for application to the image sensor. The compensationcapture mask is constructed using calculations based on the color valuesof each channel as captured with the default capture mask and the colorvalues in the uniform color image. Storage module 375 stores thecompensation capture mask in a memory of the image capture device forapplication of the compensation capture mask to the image sensor. Insome embodiments, such as that shown in FIG. 2C, image capture module370 may also include application module 376 for applying thecompensation capture mask to the image sensor, and a capture module 377for capturing and storing an image of a scene using the image sensortuned by the compensation capture mask. These modules will be discussedin more detail below with respect to FIG. 3B.

Additionally, as shown in FIGS. 2B and 2C, non-volatile memory 56 alsoincludes image data 251, which includes image data from a scene.Non-volatile memory may also store capture parameter(s) 17 forapplication to image sensor 14 so as to control spectral responsivity ofthe imaging assembly. In this embodiment, such capture parameterscomprise spatial masks 252, which control spectral responsivity of theimage sensor so as to permit pixel-by-pixel or region-by-region controlof spectral responsivity, independently of other pixels or regions.Thus, for example, a compensation capture mask can be stored in a memoryof the image capture device such as non-volatile memory 56, forapplication of the compensation capture mask to the image sensor.

Reference numeral 50 denotes a system controller, which controls theentire digital camera 100. The system controller 50 executes programsrecorded in the aforementioned nonvolatile memory 56 to implementrespective processes to be described later of this embodiment. Referencenumeral 52 denotes a system memory which comprises a RAM. On the systemmemory 52, constants and variables required to operate system controller50, programs read out from the nonvolatile memory 56, and the like aremapped.

A mode selection switch 60, shutter switch 310, and operation unit 70form operation means used to input various operation instructions to thesystem controller 50.

The mode selection switch 60 includes the imaging/playback selectionswitch, and is used to switch the operation mode of the systemcontroller 50 to one of a still image recording mode, movie recordingmode, playback mode, and the like.

The shutter switch 62 is turned on in the middle of operation (halfstroke) of the shutter button 310 arranged on the digital camera 100,and generates a first shutter switch signal SW1. Also, the shutterswitch 64 is turned on upon completion of operation (full stroke) of theshutter button 310, and generates a second shutter switch signal SW2.The system controller 50 starts the operations of the AF (auto focus)processing, AE (auto exposure) processing, AWB (auto white balance)processing, EF (flash pre-emission) processing, and the like in responseto the first shutter switch signal SW1. Also, in response to the secondshutter switch signal SW2, the system controller 50 starts a series ofprocessing (shooting) including the following: processing to read imagesignals from the image sensor 14, convert the image signals into imagedata by the A/D converter 16, process the image data by the imageprocessor 20, and write the data in the memory 30 through the memorycontroller 22; and processing to read the image data from the memory 30,compress the image data by the compression/decompression circuit 32, andwrite the compressed image data in the recording medium 200 or 210.

A zoom operation unit 65 is an operation unit operated by a user forchanging the angle of view (zooming magnification or shootingmagnification). The operation unit 65 can be configured with, e.g., aslide-type or lever-type operation member, and a switch or a sensor fordetecting the operation of the member.

The image display ON/OFF switch 66 sets ON/OFF of the image display unit28. In shooting an image with the optical finder 104, the display of theimage display unit 28 configured with a TFT, an LCD or the like may beturned off to cut the power supply for the purpose of power saving.

The flash setting button 68 sets and changes the flash operation mode.In this embodiment, the settable modes include: auto, flash-on, red-eyereduction auto, and flash-on (red-eye reduction). In the auto mode,flash is automatically emitted in accordance with the lightness of anobject. In the flash-on mode, flash is always emitted whenever shootingis performed. In the red-eye reduction auto mode, flash is automaticallyemitted in accordance with lightness of an object, and in case of flashemission the red-eye reduction lamp is always emitted whenever shootingis performed. In the flash-on (red-eye reduction) mode, the red-eyereduction lamp and flash are always emitted.

The operation unit 70 comprises various buttons, touch panels and so on.More specifically, the operation unit 70 includes a menu button, a setbutton, a macro selection button, a multi-image reproduction/repagingbutton, a single-shot/serial shot/self-timer selection button, a forward(+) menu selection button, a backward (−) menu selection button, and thelike. Furthermore, the operation unit 70 may include a forward (+)reproduction image search button, a backward (−) reproduction imagesearch button, an image shooting quality selection button, an exposurecompensation button, a date/time set button, a compression mode switchand the like.

The compression mode switch is provided for setting or selecting acompression rate in JPEG (Joint Photographic Expert Group) compression,recording in a RAW mode and the like. In the RAW mode, analog imagesignals outputted by the image sensing device are digitalized (RAW data)as it is and recorded.

Note in the present embodiment, RAW data includes not only the dataobtained by performing A/D conversion on the photoelectrically converteddata from the image sensing device, but also the data obtained byperforming lossless compression on A/D converted data. Moreover, RAWdata indicates data maintaining output information from the imagesensing device without a loss. For instance, RAW data is A/D convertedanalog image signals which have not been subjected to white balanceprocessing, color separation processing for separating luminance signalsfrom color signals, or color interpolation processing. Furthermore, RAWdata is not limited to digitalized data, but may be of analog imagesignals obtained from the image sensing device.

According to the present embodiment, the JPEG compression mode includes,e.g., a normal mode and a fine mode. A user of the digital camera 100can select the normal mode in a case of placing a high value on the datasize of a shot image, and can select the fine mode in a case of placinga high value on the quality of a shot image.

In the JPEG compression mode, the compression/decompression circuit 32reads image data written in the memory 30 to perform compression at aset compression rate, and records the compressed data in, e.g., therecording medium 200.

In the RAW mode, analog image signals are read in units of line inaccordance with the pixel arrangement of the color filter of the imagesensor 14, and image data written in the memory 30 through the A/Dconverter 16 and the memory controller 22 is recorded in the recordingmedium 200 or 210.

Note that the digital camera 100 according to the present embodiment hasa plural-image shooting mode, where plural image data can be recorded inresponse to a single shooting instruction by a user. Image datarecording in this mode includes image data recording typified by an autobracket mode, where shooting parameters such as white balance andexposure are changed step by step. It also includes recording of imagedata having different post-shooting image processing contents, forinstance, recording of plural image data having different data formssuch as recording in a JPEG form or a RAW form, recording of image datahaving the same form but different compression rates, and recording ofimage data on which predetermined image processing has been performedand has not been performed.

A power controller 80 comprises a power detection circuit, a DC-DCconverter, a switch circuit to select the block to be energized, and thelike. The power controller 80 detects the existence/absence of a powersource, the type of the power source, and a remaining battery powerlevel, controls the DC-DC converter based on the results of detectionand an instruction from the system controller 50, and supplies anecessary voltage to the respective blocks for a necessary period. Apower source 86 is a primary battery such as an alkaline battery or alithium battery, a secondary battery such as an NiCd battery, an NiMHbattery or an Li battery, an AC adapter, or the like. The main unit ofthe digital camera 100 and the power source 86 are connected byconnectors 82 and 84 respectively comprised therein.

The recording media 200 and 210 comprise: recording units 202 and 212that are configured with semiconductor memories, magnetic disks and thelike, interfaces 203 and 213 for communication with the digital camera100, and connectors 206 and 216. The recording media 200 and 210 areconnected to the digital camera 100 through connectors 206 and 216 ofthe media and connectors 92 and 96 of the digital camera 100. To theconnectors 92 and 96, interfaces 90 and 94 are connected. Theattached/detached state of the recording media 200 and 210 is detectedby a recording medium attached/detached state detector 98.

Note that although the digital camera 100 according to the presentembodiment comprises two systems of interfaces and connectors forconnecting the recording media, a single or plural arbitrary numbers ofinterfaces and connectors may be provided for connecting a recordingmedium. Further, interfaces and connectors pursuant to differentstandards may be provided for each system.

For the interfaces 90 and 94 as well as the connectors 92 and 96, cardsin conformity with a standard, e.g., PCMCIA cards, compact flash (CF)(registered trademark) cards and the like, may be used. In this case,connection utilizing various communication cards can realize mutualtransfer/reception of image data and control data attached to the imagedata between the digital camera and other peripheral devices such ascomputers and printers. The communication cards include, for instance, aLAN card, a modem card, a USB card, an IEEE 1394 card, a P1284 card, anSCSI card, and a communication card for PHS or the like.

The optical finder 104 is configured with, e.g., a TTL finder, whichforms an image from the light beam that has gone through the lens 10utilizing prisms and mirrors. By utilizing the optical finder 104, it ispossible to shoot an image without utilizing an electronic view finderfunction of the image display unit 28. The optical finder 104 includesindicators, which constitute part of the display device 54, forindicating, e.g., a focus state, a camera shake warning, a flash chargestate, a shutter speed, an f-stop value, and exposure compensation.

A communication circuit 110 provides various communication functionssuch as USB, IEEE 1394, P1284, SCSI, modem, LAN, RS232C, and wirelesscommunication. To the communication circuit 110, a connector 112 can beconnected for connecting the digital camera 100 to other devices, or anantenna can be provided for wireless communication.

A real-time clock (RTC, not shown) may be provided to measure date andtime. The RTC holds an internal power supply unit independently of thepower supply controller 80, and continues time measurement even when thepower supply unit 86 is OFF. The system controller 50 sets a systemtimer using a date and time obtained from the RTC at the time ofactivation, and executes timer control.

FIG. 3A is a view for explaining an image processing module according toone example embodiment. As previously discussed with respect to FIG. 2B,image processing module 300 comprises computer-executable process stepsstored on a non-transitory computer-readable storage medium, such asnon-volatile memory 56. More or less modules may be used, and otherarchitectures are possible.

As shown in FIG. 3A, image processing module 300 includes at leastdefault mask module 301. Default mask module 301 communicates with imagesensor 14 to apply a default capture mask to image sensor 14. Imageprocessing module 300 also includes sample module 302, which alsocommunicates with image sensor 14, and which captures a sample imageusing the image sensor tuned by the default capture mask. Analysismodule 303 analyzes color of the sample image captured by sample module302 to identify spatial non-uniformity in color sensitivity of the imagesensor. Compensation mask module 304 constructs a compensation capturemask for application to the image sensor. The compensation capture maskis constructed using calculations based on the identified spatialnon-uniformity, so as to compensate for spatial non-uniformity in colorsensitivity of image sensor 14. Storage module 305 stores thecompensation capture mask in a memory of the image capture device forapplication of the compensation capture mask to the image sensor. Inthat regard, the compensation capture mask constructed by compensationmask module 304 (and/or the default mask applied by default mask module301) can be stored in nonvolatile memory 56, for example as spatialmasks 252 shown in FIG. 2B.

In the embodiment shown in FIG. 3A, image capture module 300 furtherincludes application module 306, which applies the compensation capturemask to the image sensor 14, and capture module 307, which captures andstores an image of a scene using image sensor 14 tuned by thecompensation capture mask. The above processes will be described in moredetail below with respect to FIG. 4A.

FIG. 3B is a view for explaining an image processing module according toanother example embodiment. As previously discussed with respect to FIG.2C, image processing module 370 comprises computer-executable processsteps stored on a non-transitory computer-readable storage medium, suchas non-volatile memory 56. More or less modules may be used, and otherarchitectures are possible.

As shown in FIG. 3B, image processing module 370 includes at leastdefault mask module 371. Default mask module 371 communicates with imagesensor 14 to apply a default capture mask to image sensor 14. Imageprocessing module 370 also includes sample module 372, which alsocommunicates with image sensor 14, and which captures a sample imageusing the image sensor tuned by the default capture mask. Uniform colormodule 373 obtains a uniform color image comprising a spatial array inwhich color values for each channel are uniform throughout the wholearray. Compensation mask module 374 constructs a compensation capturemask for application to the image sensor 14. The compensation capturemask is constructed using calculations based on the color values of eachchannel as captured with the default capture mask and the color valuesin the uniform color image. Storage module 375 stores the compensationcapture mask in a memory of the image capture device for application ofthe compensation capture mask to the image sensor. In that regard, thecompensation capture mask constructed by compensation mask module 374(and/or the default mask applied by default mask module 371) can bestored in nonvolatile memory 56, for example as spatial masks 252 shownin FIG. 2C.

In the embodiment shown in FIG. 3B, image capture module 370 furtherincludes application module 376, which applies the compensation capturemask to the image sensor 14, and capture module 377, which captures andstores an image of a scene using image sensor 14 tuned by thecompensation capture mask. These processes will be described in moredetail below with respect to FIGS. 4B to 8.

FIG. 4A is a flow diagram for explaining processing in the image capturedevice shown in FIG. 1 according to an example embodiment.

Briefly, in FIG. 4A, compensation is performed for an image capturedevice which includes an image sensor which has a tunable spectralresponse and which is tunable in accordance with a capture mask. Thecompensation is for spatial non-uniformity in color sensitivity of theimage sensor. A default capture mask is applied to the image sensor, anda sample image is captured using the image sensor tuned by the defaultcapture mask. Color of the sample image is analyzed to identify spatialnon-uniformity in color sensitivity of the image sensor. A compensationcapture mask is constructed. The compensation capture mask isconstructed using calculations based on the identified spatialnon-uniformity so as to compensate for spatial non-uniformity in colorsensitivity of the image sensor. The compensation capture mask is storedin a memory of the image capture device for application of thecompensation capture mask to the image sensor.

In step 401, a default capture mask is applied to the image sensor. Morespecifically, for example, default capture setting(s) are applied to thetunable image sensor 14 for setting the spectral response of the tunableimaging assembly to a predesignated default setting. In this exampleembodiment, the default capture settings comprise the default capturemask. For example, the default capture mask can be given by electronicvoltages that have some assumptions about illumination and materialproperties of the scene, and is usually a pre-designated settingdetermined in advance such as by a calibration procedure that is made inthe imaging system assembly line.

In step 402, a sample image is captured using the image sensor tuned bythe default capture mask. In one example, the captured sample imagecomprises an image of a scene which includes a perfectly diffuseillumination which fills the field of the image sensor.

For example, the perfectly diffuse illumination can comprise a uniformgray card illuminated by a diffuse illumination. A gray card is a flatobject of a neutral gray color that derives from a flat reflectancespectrum. Its apparent brightness (and exposure determination) generallydoes not depend on its orientation relative to the light source. Byplacing a gray card in the scene to be photographed, oriented at adefined angle relative to the direction of the incident light, andtaking a reading from it with a reflected light meter, the photographercan be assured of consistent exposures across photographs.

Alternatively, the perfectly diffuse illumination can comprise anintegration sphere. An integration sphere is a sphere coated with ahighly reflective substance, providing substantial diffusion ofillumination. The image sensor does not image the sphere directly, butrather images illumination “bounced off” the sphere.

In step 403, color of the sample image is analyzed to identify spatialnon-uniformity in color sensitivity of the image sensor. In that regard,in analyzing color of the sample image, spatial non-uniformity in colorsensitivity can be identified by comparing a value of each pixel againsta combination of values of other pixels.

If there were absolutely no non-uniformities in the image sensor, allpixel signals from the sample image would be the same. Of course, thisis generally not the case, as usually there are non-uniformities in thesensor, i.e., more light being captured in center pixels, etc.

Accordingly, in step 404, a compensation capture mask is constructed forapplication to the image sensor. The compensation capture mask isconstructed using calculations based on the identified spatialnon-uniformity so as to compensate for spatial non-uniformity in colorsensitivity of the image sensor.

In one example, each channel of the image sensor is averaged, andspatial non-uniformity in color sensitivity is identified at deviationsfrom the average of each channel. Then, in constructing the compensationcapture mask, signals from each channel are normalized to the averagevalue for each such channel.

For example, for a red channel, assume pixels R01, R02, . . . R0 n. Theaverage value is R_(average)=(R01+R02+ . . . +Ron)/n. The compensationvalue for pixel R01 is R01 _(comp)=R_(average)/R01, the compensationvalue for pixel R02 is R02 _(comp)=R_(average)R02 . . . R0 n_(comp)=R_(average)/R0 n.

Other methods of constructing the compensation capture mask arepossible. For example, the compensation capture mask need not be basedon the average of each channel, but could instead be based on, forexample, the median value, a percentile of the pixel values (e.g., the60^(th) percentile), and so on.

The constructed mask indicates bias voltages to tune each pixel. Forexample, if a pixel or region is too dark, the bias voltage of thatpixel or region may be increased to increase sensitivity, and if thepixel or region is too bright, the bias voltage of that pixel or regioncould be reduced to decrease sensitivity. The necessary bias voltage isdetermined by the difference between the current voltage and thecompensation value for that pixel. Thus, for example,Rcurrent*(V)=Rcomp. In that regard, a lookup table (LUT) may be used tostore the bias voltages necessary to get from a current value for apixel to a compensated value for that pixel.

As mentioned above, the compensation capture mask can be stored in amemory of the image capture device, such as non-volatile memory 56, forapplication of the compensation capture mask to the image sensor.

In step 405, the compensation capture mask is applied to the imagesensor. Thus, the bias voltages for each pixel are adjusted inaccordance with the capture mask in order to adjust for spatialnon-uniformity in color sensitivity of the pixels.

In step 406, an image of a scene is captured using the image sensortuned by the compensation capture mask.

In step 407, the captured image is stored. For example, the capturedimage could be stored as image data 251 on non-volatile memory 56, asshown in FIG. 2B. Of course, the captured image could also be storedelsewhere, including off-site from the camera, provided that the imagecapture device is able to communicate with and transmit the image datato such remote sites.

In step 408, further adjustments are performed on the captured imagedata, using the scene captured by the image sensor tuned by thecompensation capture mask. For example, further correction could beperformed to further compensate for different illumination, as discussedbelow. In another example, the captured image data could be adjusted asdesired by an artist or photographer. Various other applications andadjustments are possible, but for purposes of conciseness are notdescribed further herein.

In one embodiment, image sensor 14 is preceded by imaging optics, andthe compensation method also compensates for spatial non-uniformity incolor sensitivity introduced by the imaging optics. For example, theimaging optics can be exchangeable with other such imaging optics, suchas different lenses or different flash emission devices, and a separatecompensation capture mask can be provided for each of such imagingoptics. The above process can be used to construct and apply acompensation capture mask to compensate for spatial non-uniformities inthe color sensitivity of each respective set of imaging optics.

In another embodiment, a separate compensation capture mask can beprovided to compensate for spatial non-uniformity in illumination of thescene. For example, external lighting conditions often may causenon-uniformities in how a scene is lit, even in controlled settings suchas professional photography. By applying the above-described process tocompensate for such spatial non-uniformities, it is ordinarily possibleto significantly reduce the amount of time necessary for processing theimage.

In still another embodiment, a compensation capture mask can beretrieved from a memory. The compensation capture mask is constructed soas to compensate for spatial non-uniformity in color sensitivity of theimage sensor. The compensation capture mask is applied to the imagesensor, and an image of a scene is captured and stored using the imagesensor tuned by the compensation capture mask.

It is also possible to use the above-described processes to compensatefor multiple situations causing non-uniformities, e.g., to compensateboth for spatial non-uniformity in color sensitivity introduced by theimaging optics as well as spatial non-uniformity in illumination of thescene. For example, a compensation capture mask could be constructed tocompensate for the imaging optics, and a second compensation capturemask could be constructed to correct for non-uniformities inillumination.

By generating a compensation capture mask for a tunable image sensorprior to image capture and applying the mask at the time of imagecapture to compensate for spatial non-uniformity in color sensitivity ofthe image sensor, it is ordinarily possible to provide improvedcompensation, because the mask addresses non-uniformities whilecapturing the raw image signal. Thus, any further adjustment of theimage sensor and/or processing of the image begins from a raw imagesignal with reduced defects and errors.

Another embodiment of image sensor compensation will be described withrespect to FIG. 4B to FIG. 8. In that regard, in certain environments,spatial non-uniformity of color due to manufacturing tolerances intunable filter arrays, chromatic aberrations, and/or non-uniformity ofspectral power distribution of light sources may lead to spatialnon-uniformity of color.

FIG. 4B is a flow diagram for explaining processing in the image capturedevice shown in FIG. 1 according to another example embodiment.

Briefly, in FIG. 4B, compensation is performed for an image capturedevice which includes an image sensor which has a tunable spectralresponse and which is tunable in accordance with a capture mask, tocompensate for spatial non-uniformity in color sensitivity of the imagesensor. A default capture mask is applied to the image sensor, and asample image is captured using the image sensor tuned by the defaultcapture mask. A uniform color image is obtained. The uniform color imagecomprises a spatial array in which color values for each channel areuniform throughout the whole array. A compensation capture mask isconstructed for application to the image sensor. The compensationcapture mask is constructed using calculations based on the color valuesof each channel as captured with the default capture mask and the colorvalues in the uniform color image. The compensation capture mask isstored in a memory of the image capture device for application of thecompensation capture mask to the image sensor.

In more detail, in step 451, a default capture mask is applied to theimage sensor. In one example, default capture setting(s) are applied tothe tunable image sensor 14 for setting the spectral response of thetunable imaging assembly to a predesignated default setting. In thisexample embodiment, the default capture settings comprise the defaultcapture mask. For example, the default capture mask can be given byelectronic voltages that have some assumptions about illumination andmaterial properties of the scene, and is usually a pre-designatedsetting determined in advance such as by a calibration procedure that ismade in the imaging system assembly line.

In step 452, a sample image is captured using the image sensor tuned bythe default capture mask. In one example, the captured sample imagecomprises an image of a scene which includes a spatially uniform target.

In step 453, a uniform RGB image is obtained. The uniform RGB image canbe obtained by, for example, generating it at image capture device 100.The uniform RGB image may, for example, comprise an x by y spatial arrayof three channels, e.g., Rn (red), Gn (green) and Bn (blue). The valuesRn, Gn and Bn can be different from each other, but generally should beuniform throughout the whole array of the uniform RGB image, to providethe constraint that the color is spatially uniform. In one example, ifthe spatially uniform target used in step 452 is grey (such as a graycard), then Rn=Gn=Bn.

In other examples, the value for each channel can be calculated as astatistical value of the distribution of the corresponding pixels. Forexample, Gn could be calculated as the average of all green pixels inthe image. Alternatively, Gn could be calculated by other statisticalcriteria, such as the median G value, 65%, 90%, etc. The same criteriacould by applied to calculate Rn and Bn. Thus, the uniform color imagemay be established according to criteria which best fit the applicationor environment.

In step 454, a compensation capture mask is constructed, by calculatingcompensation values for each channel. For example, a compensation valuefor the G channel can be calculated as CompensationG=Gn/Goriginal(x,y),where Goriginal(x,y) is the original G channel for pixel (x,y).Similarly, a compensation value for the R channel can be calculated asCompensationR=Rn/Roriginal(x,y), where Roriginal(x,y) is the original Rchannel for pixel (x,y), and a compensation value for the B channel canbe calcualted as CompensationB=Bn/Boriginal(x,y) where Boriginal(x,y) isthe original B channel for pixel (x,y).

In one approach, the compensation capture mask is constructed for acurrent pixel based on combining the value of a channel of the currentpixel and the value of a channel in another pixel, and by changing therelative magnitude between the combined pixel signals so to produce anoutput channel for the current pixel having a shifted wavelength. Putanother way, by virtue of the tunable image sensor 14, there is aspatial arrangement of pixels with adjustable magnitude, pixels can becombined to produce one specific channel, and the relative magnitudebetween combined pixel signals can be changed to produce a shift inwavelength.

As an example, FIG. 5 depicts a small portion of an imaging sensor, andin particular a spatial mosaic of pixels having controllable amplitude.While the approach could use any arbitrary colors in any arbitraryspatial distribution, for the sake of example consider a Bayer patterntrichromatic sensor A11=A22=A13=A24=A31=A42=A33=A44=Green;A12=A14=A32=A34=Red; A21=A23=A41=A43=Blue. In this case, thesensitivities of each channel are shown as the graph in FIG. 6. Theexample further assumes broad band channels with sufficient overlap.

A shift in wavelength can be created using the above arrangement bycombining (“binning”) the signals of two or more pixels, and controllingthe magnitude of each channel so as to produce the expected sensitivity.

For example, in order to shift the sensitivity of the blue channel ofpixel All depicted in FIG. 5 (and whose sensitivity is shown in FIG. 6)towards a longer wavelength, one might combine (bin) the pixel A11signal with the pixel A21 signal, and control the amplitude of thesensitivity electronically or optically to produce a linear combination0.4*A11+0.8*A21, as shown in FIG. 7. In FIG. 7, the solid linerepresents the linear combination of the sensitivity of A11 multipliedby 0.4 and A21 multiplied by A22 (each of which are represented bydotted lines). As compared to the blue channel in FIG. 6, the resultantnew channel shown in FIG. 7 is shifted towards longer wavelengths.

In a second approach, the compensation capture mask is constructed basedon a pre-calculated look-up table (LUT) in which compensation values fortransitioning between color values for a pixel are mapped to voltagevalues for each pixel. For example, assume that in step 452 that weexpect the captured color to be uniformly gray (e.g., using a gray cardfor the sample image). Under ideal conditions, the signals captured in 8bits should be Rn=125, Gn=125 and Bn=125.

However due to manufacturing process tolerances and other factors, thesignals capture from a particular pixel (x,y) might have sensitivitiesas shown in the continuous lines in FIG. 8, where Rn=150, Gn=135 andBn=100. Thus, in this example, the pixel has a shift toward red, andshould be compensated to produce a gray value. In that regard, referringto step 454, the compensation values can be derived as 0.83, 0.93 and1.25, respectively, for the R, G and B channels. In this approach, thecompensation values are mapped to voltage values through apre-calculated LUT, and such new voltage values are applied to the pixelto produce new spectral sensitivities as shown in the dotted lines inFIG. 8. In FIG. 8, the long-wavelength R channels is decreased inamplitude, and the short-wavelength B channel not only increases inmagnitude but has shifted its peak in wavelength. The G channel has alsochanged in both magnitude and peak wavelength.

In step 455, the compensation capture mask is applied to the imagesensor.

In step 456, an image of a scene is captured using the image sensortuned by the compensation capture mask.

In step 457, the captured image is stored. For example, the capturedimage could be stored as image data 251 on non-volatile memory 56, asshown in FIG. 2C. Of course, the captured image could also be storedelsewhere, including off-site from the camera, provided that the imagecapture device is able to communicate with and transmit the image datato such remote sites.

In step 458, further adjustments are performed on the captured imagedata, using the scene captured by the image sensor tuned by thecompensation capture mask. For example, further correction could beperformed to further compensate for different illumination, as discussedbelow. In another example, the captured image data could be adjusted asdesired by an artist or photographer. Various other applications andadjustments are possible, but for purposes of conciseness are notdescribed further herein.

By virtue of the above, it is ordinarily possible to compensate forspatial non-uniform sensitivities due to factors such as manufacturingtolerances, optics and uneven illumination, and in particular tocompensate by changing the wavelength properties of one or more channelsin a pixel level during capture. As such, it is ordinarily possible toreduce color aberrations during capture without post-processing. Forexample, it is ordinarily possible to reduce color artifacts due tochromatic aberration in the lens, to compensate color casts due toscenes with different types of light during capture withoutpost-processing (such as making everything look neutral in a scene thatis partly illuminated by fluorescent lamp and another part of the sceneilluminated by daylight), and to compensate for manufacturing tolerancesthat make filter sensitivities uneven for different pixels.

According to other embodiments contemplated by the present disclosure,example embodiments may include a computer processor such as a singlecore or multi-core central processing unit (CPU) or micro-processingunit (MPU), which is constructed to realize the functionality describedabove. The computer processor might be incorporated in a stand-aloneapparatus or in a multi-component apparatus, or might comprise multiplecomputer processors which are constructed to work together to realizesuch functionality. The computer processor or processors execute acomputer-executable program (sometimes referred to ascomputer-executable instructions or computer-executable code) to performsome or all of the above-described functions. The computer-executableprogram may be pre-stored in the computer processor(s), or the computerprocessor(s) may be functionally connected for access to anon-transitory computer-readable storage medium on which thecomputer-executable program or program steps are stored. For thesepurposes, access to the non-transitory computer-readable storage mediummay be a local access such as by access via a local memory busstructure, or may be a remote access such as by access via a wired orwireless network or Internet. The computer processor(s) may thereafterbe operated to execute the computer-executable program or program stepsto perform functions of the above-described embodiments.

According to still further embodiments contemplated by the presentdisclosure, example embodiments may include methods in which thefunctionality described above is performed by a computer processor suchas a single core or multi-core central processing unit (CPU) ormicro-processing unit (MPU). As explained above, the computer processormight be incorporated in a stand-alone apparatus or in a multi-componentapparatus, or might comprise multiple computer processors which worktogether to perform such functionality. The computer processor orprocessors execute a computer-executable program (sometimes referred toas computer-executable instructions or computer-executable code) toperform some or all of the above-described functions. Thecomputer-executable program may be pre-stored in the computerprocessor(s), or the computer processor(s) may be functionally connectedfor access to a non-transitory computer-readable storage medium on whichthe computer-executable program or program steps are stored. Access tothe non-transitory computer-readable storage medium may form part of themethod of the embodiment. For these purposes, access to thenon-transitory computer-readable storage medium may be a local accesssuch as by access via a local memory bus structure, or may be a remoteaccess such as by access via a wired or wireless network or Internet.The computer processor(s) is/are thereafter operated to execute thecomputer-executable program or program steps to perform functions of theabove-described embodiments.

The non-transitory computer-readable storage medium on which acomputer-executable program or program steps are stored may be any of awide variety of tangible storage devices which are constructed toretrievably store data, including, for example, any of a flexible disk(floppy disk), a hard disk, an optical disk, a magneto-optical disk, acompact disc (CD), a digital versatile disc (DVD), micro-drive, a readonly memory (ROM), random access memory (RAM), erasable programmableread only memory (EPROM), electrically erasable programmable read onlymemory (EEPROM), dynamic random access memory (DRAM), video RAM (VRAM),a magnetic tape or card, optical card, nanosystem, molecular memoryintegrated circuit, redundant array of independent disks (RAID), anonvolatile memory card, a flash memory device, a storage of distributedcomputing systems and the like. The storage medium may be a functionexpansion unit removably inserted in and/or remotely accessed by theapparatus or system for use with the computer processor(s).

By generating a compensation capture mask for a tunable image sensorprior to image capture and applying the mask at the time of imagecapture to compensate for spatial non-uniformity in color sensitivity ofthe image sensor, it is ordinarily possible to provide improvedcompensation, because the mask addresses non-uniformities whilecapturing the raw image signal. Thus, any further adjustment of theimage sensor and/or processing of the image begins from a raw imagesignal with reduced defects and errors.

This disclosure has provided a detailed description with respect toparticular representative embodiments. It is understood that the scopeof the appended claims is not limited to the above-described embodimentsand that various changes and modifications may be made without departingfrom the scope of the claims.

1. A compensation method for an image capture device which includes animage sensor which has a tunable spectral response and which is tunablein accordance with a capture mask, wherein the method compensates forspatial non-uniformity in color sensitivity of the image sensor, themethod comprising: applying a default capture mask to the image sensor;capturing a sample image using the image sensor tuned by the defaultcapture mask; analyzing color of the sample image to identify spatialnon-uniformity in color sensitivity of the image sensor; constructing acompensation capture mask for application to the image sensor, whereinthe compensation capture mask is constructed using calculations based onthe identified spatial non-uniformity so as to compensate for spatialnon-uniformity in color sensitivity of the image sensor; and storing thecompensation capture mask in a memory of the image capture device forapplication of the compensation capture mask to the image sensor.
 2. Thecompensation method according to claim 1, further comprising: applyingthe compensation capture mask to the image sensor; and capturing andstoring an image of a scene using the image sensor tuned by thecompensation capture mask.
 3. The compensation method according to claim1, wherein in analyzing color of the sample image, spatialnon-uniformity in color sensitivity is identified by comparing a valueof each pixel against a combination of values of other pixels.
 4. Thecompensation method according to claim 3, wherein in analyzing color ofthe sample image, each channel of the image sensor is averaged andspatial non-uniformity in color sensitivity is identified at deviationsfrom the average of each channel.
 5. The compensation method accordingto claim 4, wherein in constructing the compensation capture mask,signals from each channel are normalized to the average value for eachsuch channel.
 6. The compensation method according to claim 1, whereinthe captured sample image comprises an image of a scene which includes aperfectly diffuse illumination which fills the field of the imagesensor.
 7. The compensation method according to claim 6, wherein theperfectly diffuse illumination comprises a uniform gray card illuminatedby a diffuse illumination.
 8. The compensation method according to claim6, wherein the perfectly diffuse illumination comprises an integrationsphere.
 9. The compensation method according to claim 1, wherein in theimage capture device, the image sensor is not preceded by a color filterarray.
 10. The compensation method according to claim 1, wherein in theimage capture device, the image sensor is preceded by imaging optics,and wherein the compensation method also compensates for spatialnon-uniformity in color sensitivity introduced by the imaging optics.11. The compensation method according to claim 10, wherein the imagingoptics are exchangeable with other such imaging optics, and wherein aseparate compensation capture mask is provided for each of such imagingoptics.
 12. The compensation method according to claim 1, wherein aseparate compensation capture mask is provided to compensate for spatialnon-uniformity in illumination of the scene.
 13. An image capture devicewhich includes an image sensor which has a tunable spectral response andwhich is tunable in accordance with a capture mask, comprising: acomputer-readable memory constructed to store computer-executableprocess steps; and a processor constructed to execute thecomputer-executable process steps stored in the memory; wherein theprocess steps stored in the memory cause the processor to: apply adefault capture mask to the image sensor; capture a sample image usingthe image sensor tuned by the default capture mask; analyze color of thesample image to identify spatial non-uniformity in color sensitivity ofthe image sensor; construct a compensation capture mask for applicationto the image sensor, wherein the compensation capture mask isconstructed using calculations based on the identified spatialnon-uniformity so as to compensate for spatial non-uniformity in colorsensitivity of the image sensor; and store the compensation capture maskin a memory of the image capture device for application of thecompensation capture mask to the image sensor.
 14. The device accordingto claim 13, wherein the process steps further cause the processor to:apply the compensation capture mask to the image sensor; and capture andstore an image of a scene using the image sensor tuned by thecompensation capture mask.
 15. The device according to claim 13, whereinin analyzing color of the sample image, spatial non-uniformity in colorsensitivity is identified by comparing a value of each pixel against acombination of values of other pixels.
 16. The device according to claim15, wherein in analyzing color of the sample image, each channel of theimage sensor is averaged and spatial non-uniformity in color sensitivityis identified at deviations from the average of each channel.
 17. Thedevice according to claim 16, wherein in constructing the compensationcapture mask, signals from each channel are normalized to the averagevalue for each such channel.
 18. The device according to claim 13,wherein the captured sample image comprises an image of a scene whichincludes a perfectly diffuse illumination which fills the field of theimage sensor.
 19. The device according to claim 18, wherein theperfectly diffuse illumination comprises a uniform gray card illuminatedby a diffuse illumination.
 20. The device according to claim 18, whereinthe perfectly diffuse illumination comprises an integration sphere. 21.The device according to claim 13, wherein in the image capture device,the image sensor is not preceded by a color filter array.
 22. The deviceaccording to claim 13, wherein in the image capture device, the imagesensor is preceded by imaging optics, and wherein the compensationmethod also compensates for spatial non-uniformity in color sensitivityintroduced by the imaging optics.
 23. The device according to claim 22,wherein the imaging optics are exchangeable with other such imagingoptics, and wherein a separate compensation capture mask is provided foreach of such imaging optics.
 24. The device according to claim 13,wherein a separate compensation capture mask is provided to compensatefor spatial non-uniformity in illumination of the scene.
 25. An imageprocessing module for use in an image capture device which includes animage sensor which has a tunable spectral response and which is tunablein accordance with a capture mask, wherein the module compensates forspatial non-uniformity in color sensitivity of the image sensor, themodule comprising: a default mask module for applying a default capturemask to the image sensor; a sample module for capturing a sample imageusing the image sensor tuned by the default capture mask; an analysismodule for analyzing color of the sample image to identify spatialnon-uniformity in color sensitivity of the image sensor; a compensationmask module for constructing a compensation capture mask for applicationto the image sensor, wherein the compensation capture mask isconstructed using calculations based on the identified spatialnon-uniformity so as to compensate for spatial non-uniformity in colorsensitivity of the image sensor; a storage module for storing thecompensation capture mask in a memory of the image capture device forapplication of the compensation capture mask to the image sensor. 26.The image processing module according to claim 25, further comprising:an application module for applying the compensation capture mask to theimage sensor; and a capture module for capturing and storing an image ofa scene using the image sensor tuned by the compensation capture mask.27. The image processing module according to claim 25, wherein inanalyzing color of the sample image, spatial non-uniformity in colorsensitivity is identified by comparing a value of each pixel against acombination of values of other pixels.
 28. The image processing moduleaccording to claim 27, wherein in analyzing color of the sample image,each channel of the image sensor is averaged and spatial non-uniformityin color sensitivity is identified at deviations from the average ofeach channel.
 29. The image processing module according to claim 28,wherein in constructing the compensation capture mask, signals from eachchannel are normalized to the average value for each such channel. 30.The image processing module according to claim 25, wherein the capturedsample image comprises an image of a scene which includes a perfectlydiffuse illumination which fills the field of the image sensor.
 31. Theimage processing module according to claim 30, wherein the perfectlydiffuse illumination comprises a uniform gray card illuminated by adiffuse illumination.
 32. The image processing module according to claim30, wherein the perfectly diffuse illumination comprises an integrationsphere.
 33. The image processing module according to claim 25, whereinin the image capture device, the image sensor is not preceded by a colorfilter array.
 34. The image processing module according to claim 25,wherein in the image capture device, the image sensor is preceded byimaging optics, and wherein the compensation method also compensates forspatial non-uniformity in color sensitivity introduced by the imagingoptics.
 35. The image processing module according to claim 34, whereinthe imaging optics are exchangeable with other such imaging optics, andwherein a separate compensation capture mask is provided for each ofsuch imaging optics.
 36. The image processing module according to claim25, wherein a separate compensation capture mask is provided tocompensate for spatial non-uniformity in illumination of the scene. 37.A computer-readable storage medium removably storing computer-executableprocess steps for causing a computer to perform a compensation methodfor an image capture device which includes an image sensor which has atunable spectral response and which is tunable in accordance with acapture mask, wherein the method compensates for spatial non-uniformityin color sensitivity of the image sensor, the method comprising:applying a default capture mask to the image sensor; capturing a sampleimage using the image sensor tuned by the default capture mask;analyzing color of the sample image to identify spatial non-uniformityin color sensitivity of the image sensor; constructing a compensationcapture mask for application to the image sensor, wherein thecompensation capture mask is constructed using calculations based on theidentified spatial non-uniformity so as to compensate for spatialnon-uniformity in color sensitivity of the image sensor; and storing thecompensation capture mask in a memory of the image capture device forapplication of the compensation capture mask to the image sensor. 38.The computer-readable storage medium according to claim 37, wherein themethod further comprises: applying the compensation capture mask to theimage sensor; and capturing and storing an image of a scene using theimage sensor tuned by the compensation capture mask.
 39. Thecomputer-readable storage medium according to claim 37, wherein inanalyzing color of the sample image, spatial non-uniformity in colorsensitivity is identified by comparing a value of each pixel against acombination of values of other pixels.
 40. The computer-readable storagemedium according to claim 39, wherein in analyzing color of the sampleimage, each channel of the image sensor is averaged and spatialnon-uniformity in color sensitivity is identified at deviations from theaverage of each channel.
 41. The computer-readable storage mediumaccording to claim 40, wherein in constructing the compensation capturemask, signals from each channel are normalized to the average value foreach such channel.
 42. The computer-readable storage medium according toclaim 37, wherein the captured sample image comprises an image of ascene which includes a perfectly diffuse illumination which fills thefield of the image sensor.
 43. The computer-readable storage mediumaccording to claim 42, wherein the perfectly diffuse illuminationcomprises a uniform gray card illuminated by a diffuse illumination. 44.The computer-readable storage medium according to claim 42, wherein theperfectly diffuse illumination comprises an integration sphere.
 45. Thecomputer-readable storage medium according to claim 37, wherein in theimage capture device, the image sensor is not preceded by a color filterarray.
 46. The computer-readable storage medium according to claim 37,wherein in the image capture device, the image sensor is preceded byimaging optics, and wherein the compensation method also compensates forspatial non-uniformity in color sensitivity introduced by the imagingoptics.
 47. The computer-readable storage medium according to claim 46,wherein the imaging optics are exchangeable with other such imagingoptics, and wherein a separate compensation capture mask is provided foreach of such imaging optics.
 48. The computer-readable storage mediumaccording to claim 37, wherein a separate compensation capture mask isprovided to compensate for spatial non-uniformity in illumination of thescene.
 49. A compensation method for an image capture device whichincludes an image sensor which has a tunable spectral response and whichis tunable in accordance with a capture mask, comprising: retrieving acompensation capture mask from a memory, wherein the compensationcapture mask is constructed so as to compensate for spatialnon-uniformity in color sensitivity of the image sensor; applying thecompensation capture mask to the image sensor; and capturing and storingan image of a scene using the image sensor tuned by the compensationcapture mask.
 50. A compensation method for an image capture devicewhich includes an image sensor which has a tunable spectral response andwhich is tunable in accordance with a capture mask, wherein the methodcompensates for spatial non-uniformity in color sensitivity of the imagesensor, the method comprising: applying a default capture mask to theimage sensor; capturing a sample image using the image sensor tuned bythe default capture mask; obtaining a uniform color image comprising aspatial array in which color values for each channel are uniformthroughout the whole array; constructing a compensation capture mask forapplication to the image sensor, wherein the compensation capture maskis constructed using calculations based on the color values of eachchannel as captured with the default capture mask and the color valuesin the uniform color image; and storing the compensation capture mask ina memory of the image capture device for application of the compensationcapture mask to the image sensor.
 51. The method according to claim 50,wherein the compensation capture mask is constructed for a current pixelbased on combining the value of a channel of the current pixel and thevalue of a channel in another pixel and changing the relative magnitudebetween the combined pixel signals so to produce an output channel forthe current pixel having a shifted wavelength.
 52. The method accordingto claim 50, wherein the compensation capture mask is constructed basedon a pre-calculated look-up table (LUT) in which compensation values fortransitioning between color values for a pixel are mapped to voltagevalues for each pixel.
 53. An image capture device which includes animage sensor which has a tunable spectral response and which is tunablein accordance with a capture mask, comprising: a computer-readablememory constructed to store computer-executable process steps; and aprocessor constructed to execute the computer-executable process stepsstored in the memory; wherein the process steps stored in the memorycause the processor to: apply a default capture mask to the imagesensor; capture a sample image using the image sensor tuned by thedefault capture mask; obtain a uniform color image comprising a spatialarray in which color values for each channel are uniform throughout thewhole array; construct a compensation capture mask for application tothe image sensor, wherein the compensation capture mask is constructedusing calculations based on the color values of each channel as capturedwith the default capture mask and the color values in the uniform colorimage; and store the compensation capture mask in a memory of the imagecapture device for application of the compensation capture mask to theimage sensor.
 54. The device according to claim 53, wherein thecompensation capture mask is constructed for a current pixel based oncombining the value of a channel of the current pixel and the value of achannel in another pixel and changing the relative magnitude between thecombined pixel signals so to produce an output channel for the currentpixel having a shifted wavelength.
 55. The device according to claim 53,wherein the compensation capture mask is constructed based on apre-calculated look-up table (LUT) in which compensation values fortransitioning between color values for a pixel are mapped to voltagevalues for each pixel.
 56. An image processing module for use in animage capture device which includes an image sensor which has a tunablespectral response and which is tunable in accordance with a capturemask, wherein the module compensates for spatial non-uniformity in colorsensitivity of the image sensor, the module comprising: a default maskmodule for applying a default capture mask to the image sensor; a samplemodule for capturing a sample image using the image sensor tuned by thedefault capture mask; a uniform color module for obtaining a uniformcolor image comprising a spatial array in which color values for eachchannel are uniform throughout the whole array; a compensation maskmodule for constructing a compensation capture mask for application tothe image sensor, wherein the compensation capture mask is constructedusing calculations based on the color values of each channel as capturedwith the default capture mask and the color values in the uniform colorimage; and a storage module for storing the compensation capture mask ina memory of the image capture device for application of the compensationcapture mask to the image sensor.
 57. The module according to claim 56,further comprising: an application module for applying the compensationcapture mask to the image sensor, wherein the compensation capture maskis constructed for a current pixel based on combining the value of achannel of the current pixel and the value of a channel in another pixeland changing the relative magnitude between the combined pixel signalsso to produce an output channel for the current pixel having a shiftedwavelength; and a capture module for capturing and storing an image of ascene using the image sensor tuned by the compensation capture mask. 58.The module according to claim 56, further comprising: an applicationmodule for applying the compensation capture mask to the image sensor,wherein the compensation capture mask is constructed based on apre-calculated look-up table (LUT) in which compensation values fortransitioning between color values for a pixel are mapped to voltagevalues for each pixel; and a capture module for capturing and storing animage of a scene using the image sensor tuned by the compensationcapture mask.
 59. A non-transitory computer-readable storage mediumremovably storing computer-executable process steps for causing acomputer to perform a compensation method for an image capture devicewhich includes an image sensor which has a tunable spectral response andwhich is tunable in accordance with a capture mask, wherein the methodcompensates for spatial non-uniformity in color sensitivity of the imagesensor, the method comprising: applying a default capture mask to theimage sensor; capturing a sample image using the image sensor tuned bythe default capture mask; obtaining a uniform color image comprising aspatial array in which color values for each channel are uniformthroughout the whole array; constructing a compensation capture mask forapplication to the image sensor, wherein the compensation capture maskis constructed using calculations based on the color values of eachchannel as captured with the default capture mask and the color valuesin the uniform color image; and storing the compensation capture mask ina memory of the image capture device for application of the compensationcapture mask to the image sensor.
 60. The computer-readable storagemedium according to claim 59, wherein the compensation capture mask isconstructed for a current pixel based on combining the value of achannel of the current pixel and the value of a channel in another pixeland changing the relative magnitude between the combined pixel signalsso to produce an output channel for the current pixel having a shiftedwavelength.
 61. The computer-readable storage medium according to claim59, wherein the compensation capture mask is constructed based on apre-calculated look-up table (LUT) in which compensation values fortransitioning between color values for a pixel are mapped to voltagevalues for each pixel.